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Abstract 


The Third Homomorphism Theorem is a folk theorem of the constructive algorithmics 
community, ft states that a function on lists that can be computed both from left to right 
and from right to left is necessarily a list homomorpihism — it can be computed according 
to any parenthesization of the list. 

We formalize and prove the theorem, and use it to improve an 0(n 2 ) sorting algorithm 
to 0(n log n). 


1 Introduction 

List homomorphisms are those functions on finite lists that promote through list 
concatenation — that is, functions h for which there exists a binary operator © such 
that, for all finite lists x and y, 

h (x -\\- y) = h x © h y 

where ‘-H-’ denotes list concatenation. Such functions are ubiquitous in functional 
programming. Some examples of list homomorphisms are: 

• the identity function id', 

• the map function map f , which applies a given function / to every element of 
a list; 

• the function concat, which concatenates a list of lists into a single long list; 

• the function head, which returns the first element of a list; 

• the function length, which returns the length of a list; 

• the functions sum, mm and all, which return the sum, the smallest and the 
boolean conjunction of the elements of a list, respectively. 

However, there are also many useful list functions that are not list homomor- 
phisms. One example is the function Isp, which returns the longest sorted prefix of 
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a list. Knowing Isp x and Isp y is not enough to allow computation of Isp (x -H- y). 
This function is a typical example of a leftwards function — one which can be com- 
puted from right to left. Dually, the rightwards functions can be computed from 
left to right. 

One obvious relationship between homomorphisms and leftwards and rightwards 
functions is known as the Specialization Theorem (Bird, 1987): all homomorphisms 
are also leftwards and rightwards functions. In the Constructive Algorithmics com- 
munity, this has become known as the ‘Second Homomorphism Theorem’. (The 
‘First Homomorphism Theorem’ states that a homomorphism can be factored into 
the composition of reduction — a homomorphism whose value on a singleton list is 
the sole element of that list — with a map, and conversely that any such composition 
is a homomorphism.) 

The subject of this paper is another relationship between homomorphisms and 
leftwards and rightwards functions. This relationship is much less obvious, but is 
equally useful. It is the converse of the Specialization Theorem, and states that 
any function that is both leftwards and rightwards is also a homomorphism. This 
theorem is fairly well-known in the Constructive Algorithmics community, bearing 
the name ‘The Third Homomorphism Theorem’. However, it has somewhat the 
status of a ‘folk theorem’ (Harel, 1980). It was conjectured by Richard Bird and 
proved by Lambert Meertens during a train journey across the Netherlands in 1989 
(Meertens, 1995); the theorem has been published only in non-archival sources 
(Barnard et at, 1991; Gibbons, 1993), and we feel that it deserves wider recognition. 

In this paper we formalize and prove this theorem, and use it to derive ‘mergesort’ 
from ‘insertsort’. The remainder of this paper is structured as follows. In Section 2, 
we introduce the necessary notation. In Section 3, we state the First and Second 
Homomorphism Theorems, for completeness’ sake. Section 4 contains the main 
result of the paper, the Third Homomorphism Theorem. In Section 5, we use the 
theorem to derive mergesort from insertsort. 

An earlier version of this paper appeared as (Gibbons, 1994). 


2 Notation 

In this section, we introduce the notation used in the rest of the paper. 

Functions: Function application is denoted by juxtaposition, is tightest binding, 
and associates to the left. Function composition is written ‘o’. 

Lists: For the purposes of this paper, lists are finite sequences of elements, all of 
the same type. A list is either empty, a singleton, or the concatenation of two 
other lists. We write ‘ [ ] ’ for the empty list, ‘[a]’ for the singleton list with 
element a (and ‘ [•] ’ for the function taking a to [a]), and ‘x -H- y’ for the 
concatenation of x and y. Concatenation is associative, and [] is its unit. For 
example, the term [ai] -H- [02] -H- [as] denotes a list with three elements, often 
written in the abbreviated form [ai, a?, 03 ]. We also write ‘a : x’ for [a] -H- x\ 
the operator ‘:’ associates to the right. 
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Homomorphisms: For a binary operator ©, the list function h is Q-homomorphic 
iff, for all lists x and y, 

h (x -\\- y) = h x © h y 

For example, the functions length and sum are both ©-homomorphic, since 
sum (x -H- y) = sum x + sum y 
length (x -H- y) = length x + length y 

Note that © is necessarily associative on the range of h, because -H- is asso- 
ciative. Moreover, h [] is necessarily the unit of © on the range of h (if it 
exists), because [] is the unit of -H-. If © has no unit, then h [] is not defined. 
For example, head is ^©homomorphic where a <C b = a, but because <C has 
no unit, head [] is undefined. 

For associative operator © with unit e, we write l hom (©) / e’ for the (unique) 
©-homomorphic function h for which h <>[•]= /. For example, 

sum = horn (+) id 0 
length = length = horn (+) one 0 
where one a = 1 for all a. 

Leftwards and rightwards functions: The list function h is (B-leftwards for bi- 
nary operator © iff, for all elements a and lists y, 

h ([a] -H- y) = a © h y 

Here, © need not be associative. The (unique) ©-leftwards function h for 
which h [] = e is written c foldr (©) e’. For example, the function Isp referred 
to earlier is ©-leftwards where 
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unique ©-rightwards function h for which h [] = e. Expanding the definition 
reveals a left-to-right pattern of computation. For example: 

foldl ((g>) e [a 1; a 2 , a 3 \ = ((e © ai) © a 2 ) © a 3 

and in general: 

foldl ((g)) e (x y) = foldl (©) ( foldl (©) e x) y (2) 


3 The First and Second Homomorphism Theorems 

For the sake of completeness, we state without proof the First and Second Homo- 
morphism Theorems. 


Definition 3.1 

A function of the form horn (©) id e for some © is called a reduction. 

Definition 3.2 

For given /, the function horn (-H-) ([•] of) [] is written c map /’ and called a map. 


Theorem 3.3 (First Homomorphism Theorem) 

Every homomorphism can be written as the composition of a reduction and a map: 
horn (©) / e = horn (©) id e o map f 
Conversely, every such composition is a homomorphism. 


Theorem 3.) (Second Homomorphism Theorem, or Specialization Theorem) 

Every homomorphism is both a leftwards and a rightwards function. That is, if © 
is associative, then 

horn (©) / e = foldr (©) e where a®s=f a Q s 

= foldl (©) e where r©a = r©/a 


4 The Third Homomorphism Theorem 

This section contains the main result of the paper, the statement and proof of the 
Third Homomorphism Theorem. 


Theorem ).l (Third Homomorphism Theorem) 

If h is leftwards and rightwards, then h is a homomorphism. 
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In fact, we will show that h is ©-homomorphic where 

t Q u = h (g t -\\- g u) 

for some g such that h ° g ° h = h. Such a g exists, as the following lemma shows. 


Lemma J t .2 

For every computable total function h with enumerable domain, there is a com- 
putable (but possibly partial) function g such that h ° g ° h = h. 


Proof 

Here is one suitable definition of g. To compute g t for some t, simply enumerate 
the domain of h and return the first x such that h x = t. If t is in the range of h, 
then this process terminates. D 

The proof of the Third Homomorphism Theorem relies on the following lemma: 
Lemma 4-3 

The list function h is a homomorphism iff the implication 

hv = hxt\hw = hy => h (v -\\- w) = h (x -\\- y) (3) 

holds for all lists v,w,x,y. 

(We note in passing an interesting corollary to Lemma 4.3: any injective function 
is homomorphic.) 

Proof 

The ‘only if’ is obvious: if h is a homomorphism, then there is a © such that 
h (x -\\- y) = h x ® h y for all lists x and y. Now consider the ‘if’ part. 

Assume that h satisfies (3). Choose a g such that ho go h = h, and define operator 
© by the equation 

t Q u = h (g t -\\- g u) 

(as in the statement of the Third Homomorphism Theorem). We show that h is 
©-homomorphic. 

Because of the way we chose g , h x = h (g (h x)) and h y = h (g (h y )), and so, 
by (3) (with v = g (h x) and w = g (h y )), we have 

h (x -W- y) = h (g (h x) -H- g (h y) ) 

= h x © h y 

□ 

We now prove the Third Homomorphism Theorem. 

Proof 

We show that, if h is leftwards and rightwards, then h satisfies (3). 
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Suppose that h = foldr (®) e = foldl (®) e, and that h v = h x and h w = h y . 
Then: 

h (v -H- w ) 

= { treating h as a leftwards function } 

foldr (®) e (v -H- w) 

{ (1) } 

foldr (®) ( foldr (®) e w) v 
= { since h w = h y } 

foldr (®) ( foldr (®) e y) v 

{ (1) } 

foldr (®) e (v -++- y) 

= { treating h as a leftwards function } 

h(v-W-y) 

= { symmetrically, treating h as a rightwards function } 

h (x -H- y) 

Hence, by Lemma 4.3, h is a homomorphism. D 


5 Application: sorting 

We now use the Third Homomorphism Theorem to derive the O(nlogn) sorting 
algorithm ‘mergesort’ from the 0(n 2 ) ‘insertsort’. (In fact, the Third Homomor- 
phism Theorem yields only an inefficient homomorphic sorting algorithm; we have 
to do a little more work to derive mergesort itself.) 

The function sort, which sorts a list, is leftwards, since it can be written 

sort = foldr ms [] 

where 


ms a [] 
ms a (b : x) 


f a : b : x, if a < b 

\ b : (ms a x ), otherwise 


This is just traditional ‘insertsort’, and takes 0(n 2 ) time to sort n elements. 

The same function is also rightwards, since it can be written as a ‘backwards 
insertsort’: 


where 


sort = foldl ms' [] 


(4) 


/ 


ms x a 


ms a x 
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The Third Homomorphism Theorem concludes that sort is therefore homomorphic. 
The homomorphism constructed by the proof is hom (©) [•] [] where 

u © v = sort ( unsort u -H- unsort v) 

for some function unsort such that sortounsorto sort = sort, that is, which permutes 
the elements of a list. 

We pick unsort = id for simplicity, giving 

u © v = sort (u -H- v) (5) 

This gives us a homomorphic method of sorting, but clearly it is very inefficient. 
To sort ir -H - y, we sort x and y (yielding u and v), concatenate u and v, and then 
(presumably using some other sorting method, such as insertsort) sort the result 
u -H- v . However, we can improve this algorithm, by capitalizing on the fact that — in 
the context of evaluating hom (©) [•] [] — the arguments u and v to © will be sorted. 
This improvement takes us directly to the traditional ‘mergesort’ algorithm, which 
is 0(n log n). 

Suppose first that u is sorted, that is, that u = sort u. Then 

u © v 

{ ( 5 ) } 

sort (u -H- v) 

{ ( 4 ) } 

foldl ins' [] (u -H- v) 

{ ( 2 ) } 

foldl ins' ( foldl ins' [] u) v 

{ ( 4 ) } 

foldl ins' (sort u) v 
= { u is sorted } 

foldl ins' u v 

= { let merge = foldl ins' } 

merge u v 

We have picked a suggestive name in the last step, but it is justified by the 
observation that 


merge u [] = foldl ins' u [] 

= u 


and 


merge u (b : v) = foldl ins' u (b : v) 

= foldl ins' (ins' u b) v 
= merge (ins' u b) v 


This is a straightforward method of merging two lists, the first one already sorted, to 
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produce a sorted list. Note, however, that it takes quadratic time, and so computing 
horn merge [•] [] also takes quadratic timef. We can make a further improvement 
by assuming that the second argument to merge is also sorted. 

We use the following lemma, which is easily proved by induction. We write 1 a < v’ 
to denote that a < b for every element b of list v. 

Lemma 5.1 

If a < x and a < y, then 

foldl ins' (a : x) y = a : foldl ins' x y 
Suppose that v is sorted. Then 

merge [] v 

= { definition of merge } 

foldl ins' [] v 

{ (4) } 

sort v 

= { v is sorted } 

v 

Now suppose that a : u and b : v are sorted. Then 

merge (a : u) (b : v) 

= { definition of merge } 

foldl ins' (a : u) (b : v) 

= { defining property of foldl } 

foldl ins' (ins' (a : u) b) v 

We now consider the cases a < b and a > b separately. 

Case a < b: Since a : u and b : v are sorted, we have a < u and a < v; hence 
a < ins' u b also. Then 

foldl ins' (ins' (a : u) b) v 
= { ins') a < b } 

foldl ins' (a : ins' u b) v 
= { Lemma 5.1 } 

a : foldl ins' (ins' u b) v 
= { defining property of foldl } 

a : foldl ins' u (b : v) 

= { definition of merge } 

a : merge u (b : v) 


f because Xl'lV 2 '(f) 2 - 2ra 2 
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Case a > b: Since a : u and b : v are sorted, we have b < a : u and b < v. Then 

foldl ins' (ins' (a : u) b) v 
= { ins') a > b } 

foldl ins' (b : a : u) v 
= { Lemma 5.1 } 

b : foldl ins' (a : u) v 
= { definition of merge } 

b : merge (a : u) v 

We have just derived the following characterization of merge, when both of its 
arguments are sorted: 


merge [] v 
merge u [] 

merge (a : u) (b : v) 


v 


f a : merge u (b : v), if a < b 
\ b : merge (a : u ) v, otherwise 


which is the standard way of merging two sorted lists (except that the comparison 
is usually ‘ a < ¥ rather than l a < ¥). This version of merge takes linear time, 
and yields the well-known mergesort algorithm, which is O(nlogn) when the list 
is decomposed in a balanced fashion. Green and Barstow (1978) describe a similar 
derivation of merge and mergesort. 


6 Conclusion 

To summarize, we have presented and proved Bird and Meertens’ Third Homomor- 
phism Theorem, stating that any function on lists that can be computed both from 
left to right and from right to left is necessarily a list homomorphism. We gave 
an example of its use — deriving ‘mergesort’ from ‘insertsort’ — illustrating that the 
theorem does not usually give an efficient characterization of the homomorphism; 
further development must be done to produce this. 

Further applications of the Third Homomorphism Theorem are given by Barnard 
et al. (1991), Gibbons (1993), and Gorlatch (1995). 
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